Skip to content

add missing lco-3b mieb-lite results#574

Merged
Samoed merged 2 commits into
mainfrom
lco-results
Jun 18, 2026
Merged

add missing lco-3b mieb-lite results#574
Samoed merged 2 commits into
mainfrom
lco-results

Conversation

@gowitheflow-1998

Copy link
Copy Markdown
Member

adding a few missing MIEB-lite task results for LCO-Embedding-Omni-3B.

Checklist

  • My model has a model sheet, report, or similar
  • My model has a reference implementation in mteb/models/model_implementations/, this can be as an API. Instruction on how to add a model can be found here
    • No, but there is an existing PR ___
  • The results submitted are obtained using the reference implementation
  • My model is available, either as a publicly accessible API or publicly on e.g., Huggingface
  • I solemnly swear that for all results submitted I have not trained on the evaluation dataset including training splits. If I have, I have disclosed it clearly.

@github-actions

Copy link
Copy Markdown

Model Results Comparison

Reference models: intfloat/multilingual-e5-large, google/gemini-embedding-001
New models evaluated: LCO-Embedding/LCO-Embedding-Omni-3B

Results for LCO-Embedding/LCO-Embedding-Omni-3B

task_name LCO-Embedding/LCO-Embedding-Omni-3B Max result Model with max result In Training Data
CIRRIT2IRetrieval .275 .350 voyageai/voyage-multimodal-3 False
Fashion200kI2TRetrieval .061 .241 google/siglip-large-patch16-384 False
NIGHTSI2IRetrieval .249 .265 QuanSun/EVA02-CLIP-bigE-14-plus False
OVENIT2TRetrieval .181 .164 voyageai/voyage-multimodal-3 False
VisualNewsI2TRetrieval .119 .464 QuanSun/EVA02-CLIP-bigE-14-plus False
VisualSTS17Multilingual .788 .678 voyageai/voyage-multimodal-3 False
Average .279 .360 nan -

Model have high performance on these tasks: VisualSTS17Multilingual,OVENIT2TRetrieval


@Samoed Samoed enabled auto-merge (squash) June 18, 2026 14:38
@Samoed Samoed merged commit a2dba76 into main Jun 18, 2026
2 of 3 checks passed
@Samoed Samoed deleted the lco-results branch June 21, 2026 20:58
@gowitheflow-1998 gowitheflow-1998 mentioned this pull request Jul 1, 2026
6 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants